What the language model cannot do